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Abstract 

Signal transduction in biological cells is effected by signaling pathways that 
typically include multiple feedback loops. Here we analyze information transfer 
through a prototypical signaling module with biochemical feedback. The mod¬ 
ule switches stochastically between an inactive and active state; the input to the 
module governs the activation rate while the output (i.e., the product concen¬ 
tration) perturbs the inactivation rate. Using a novel perturbative approach, 
we compute the rate with which information about the input is gained from 
observation of the output. We obtain an explicit analytical result valid to first 
order in feedback strength and to second order in the strength of input. The 
total information gained during an extended time interval is found to depend on 
the feedback strength only through the total number of activation/inactivation 
events. 

Keywords: Signal transduction, Communication channel, Poisson process, 
Information theory, Feedback loop, Non-Markovian process 


1. Introduction 

Accurate sensing of the environment is crucial for the survival of biological 
organisms. Bacteria, as well as animal chemoreceptor cells, can sense certain 
chemicals in their chemical environment with high precision, in some cases near 
the single-molecule detection limit mm- The effect of the extracellular stim¬ 
ulus on the cell is mediated by the signal transduction pathway - a complex 
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biochemical reaction network. The pathway is based on a sequence of transduc¬ 
tion steps, with each subsequent step being effected by the chemical product of 
the previous step. The first step typically consists in the activation of a receptor 
protein in the cell membrane by the external stimulus, which results in an ion 
influx or in the production of a second messenger chemical. This leads to the ac¬ 
tivation of subsequent steps within the cell. Through molecular feedback loops, 
the product of a given transduction step may regulate its own production, or 
influence earlier (upstream) steps of the pathway. As signal transduction path¬ 
ways are inherently noisy [3], faithful transmission of information through the 
pathways requires amplification and/or adaptation. This is often accomplished 
through positive (amplification) and negative (adaptation) feedback built into 
the reaction network. 

Recent years have brought the use of information-based measures to char¬ 
acterize the reliability of biological signal transduction HISIIIIT]. Such mea¬ 
sures explicitly evaluate the amount of information about the stimulus that it 
is trasmitted through the signaling pathway. Mutual information between the 
stimulus and the pathway output (i.e., the product of the final transduction 
step) was evaluated in, e.g.[SJ|B] , to assess the precision with which stationary 
stimuli of different strengths can be distinguished. In many signaling scenar¬ 
ios, however, it is important to faithfully transduce the temporal variations of 
the input stimulus, which encode biologically important information. Some re¬ 
cent studies have evaluated the transduction reliability for time-varying signals 
by computing the information transmission rate. In [7], prototypical signaling 
pathways with feedback were represented by coupled Langevin equations with 
additive Gaussian noise, and thefrequency-dependent gain-to-noise ratio was 
computed. In the Gaussian noise approximation, this gain (together with the 
input power spectrum) determines the the mutual information between the time 
courses of the stimulus and of the output. Some of the stochasticity within a sig¬ 
naling pathway, however, arises directly from the inherent stochastic dynamics 
of the transduction components, and cannot always betreated as additive noise; 
in such a case, the information calculation cannot be reduced to the evaluation 
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of the gain-to-noise ratio. 

In this work, we carry out a perurbative computation of information trans¬ 
fer through a simple prototypical signaling module with biochemical feedback. 
The module switches stochastically between two states, with switching rates 
governed by the stimulus (i.e., input) and by the product (i.e., output). No 
additive external noise is assumed. Such autoregulated stochastic modules arise 
within various signal transduction and gene regulation pathways (see Sec. 2). 
In a previous investigation [5] negative feedback, in this module, was shown to 
decrease the signal-to-noise ratio (SNR) at the output, but at the same time to 
increase the spectral range of the response - thus yielding no obvious expectation 
on how feedback overall affectsinformation transmission through the module. 
Here, we address this question by directly quantifying the information that is 
gained about the external stimulus from following the module output. In order 
to achieve this we introduce a novel perturbative approach on a conveniently 
defined relative entropy for stochastic point processes [5] . This information gain 
is well-defined for a single stimulus trajectory (i.e., it requires no averaging over 
stimuli as in mutual-information-based measures) j9]. We obtain an explicit 
analytical result valid to first order in feedback strength and to second order in 
the strength of input. Surprisingly, the total information gained during a long 
time interval is found to be proportional to the total number of state-switching 
events, with no further dependence on the feedback strength or on the spectral 
distribution of the input. We compare this result to previous investigations of 
information transfer through some related information channels. 

2. A two-state signaling module with feedback 

We consider a simple signaling module based on a single protein that switches 
between two conformational states. These may correspond to the open and 
closed state of an ion channel, or to the active/inactive states of an enzyme 
within a larger signaling network. We introduce the module by referring to the 
example of a calcium ion channel that is autoregulated by calcium-mediated 
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feedback. When the channel is open, calcium ions flow from the extracellular 
space into the cell. This leads to a fast increase of the free calcium concen¬ 
tration in the immediate vicinity of the channel (the increase is localized as 
calcium buffering in the cytoplasm leads to the formation of a calcium mi¬ 
crodomain m ). For certain types of calcium channels (such as the voltage- 
activated L-type channels [12] or the cyclic-nucleotide-gated (CNG) channels 
[13 (Hi), the cytoplasmic calcium can inactivate the channel when it binds to 
the channel/calmodulin complex. This implements an autoregulatory feedback 
loop that shortens the response to the external gating signal, and thus helps 
to faithfully transduce fast signal variations. Similar autoregulatory loops, in 
which the product of a particular step in the pathway downregulates its own 
production, arise in numerous signal transduction and gene regulation networks 

m- 

The stochastic switching of the channel state is governed by the opening rate 
(assumed to depend on the extracellular stimulus gating the channel) and the 
closing rate. The negative autoregulation may be effected through a calcium- 
dependent increase of the closing rate or decrease of the opening rate. For the 
CNG channels that motivated us in this study, electrophysiological data indi¬ 
cates that the binding of calcium to the channel/calmodulin complex increases 
the closing rate. We consequently make only the closing rate depend on the 
calcium concentration. 

The signaling module is shown schematically in Fig. 1. When the channel is 
in the open state, ions flow into the microdomain at a fixed rate J. Once inside 
the microdomain, the ions are cleared out through ion pumps or exchangers 
in the membrane, as well as by diffusion within the cytoplasm; we assume a 
first-order clearance kinetics with rate constant A (see Fig. 1). The dynamics 
of the concentration c of ions in the cell compartment is given by the following 
equation: 

^ ( 1 ) 

where J is the flow of ions entering the cell through the open channel, A the 
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volume of the cell micro-domain and the two-valued function S(t) = 1 or 0 
indicates the open or closed state of the channel. Adopting the dimensionless 


S=0 



Figure 1: The ion-channel (gray) opens with rate 7 + governed by the input V(t) and closes 
with rate 7 _ that depends on the ion concentration c{t) (which is considered to be the output). 
Ions inside the micro-domain (dashed box) are cleared out at rate A. 


variable a{t) = c{t)XA/J, Eq. 0 becomes 

( 2 ) 

and cr(t) is restricted to the range [0,1]. Examples of trajectories of a{t) are 
shown in Fig. 2. The switching events of the channel between time 0 and t: 


0 <ti <t 2 < ■ ■ ■ <tn <t 


(3) 


are the realization of a stochastic point process driving the dynamics of cr(t). In 
fact, fixed a sequence tn = (0, ti, • • • , tn) of such events and the initial condition 
S'(O) = i and cr(0) = CTo, an exact solution for a{t) follows directly from Eq. 0: 

n—1 

CTo-i-f (-1)'^ 


cr{t\t2n) = i + 


j=o 


a{t\t2n+l) = i - i+ [cr{t = t2n+l\t2n) - i+i]e *2-+i). 


(4) 


Eqs. 0 determine a{t) after either an even or an odd sequence of switching 
events and show how this variable keeps a full record (memory) of these events. 

We assume that the external input V{t) gates the channel by perturbing 
only the opening rate, i.e. 


7+ =7+{^ + £vV{t)), 


(5) 
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while the internal ion concentration affects the closing rate 


7- =7-(l + £<Tcr(t)). 


( 6 ) 


When £cr > 0, an increase in calcium concentration leads to faster closing of the 
channel and hence a reduced calcium influx. Therefore > 0 corresponds to 
negative autoregulation and £ 0 - < 0 to positive feedback on the calcium dynamics 
(to guarantee that 7 _ remains positive in Eq. > — 1 is required). Note 

that the opening rate in Eq. (§ depends, through Eq. on the whole history 
of previous openings and closings of the channel. The feedback introduced 
through £ 0 - therefore renders the channel state dynamics non-Markovian. 

3. Signal-induced information gain 

As quantification of the information transfer we adopt the information gained 
during the interval [0,t] due to the stimulus E [H]. To introduce this measure 
of information transfer we start from the definition of entropy for a stochastic 
point process that generates switching events. Denoting by ti,to) 

the probability density that a sequence of n events occurs at time ti,... ,tn 
between time to and t the entropy of the stochastic process during this time 
interval can be written as 




Eq. Q is the natural extension of the Shannon entropy to a continuous-time 


process assuming a finite resolution At with which the continuous-time variable 
can be measured. This r-entropy, as well as the difference of such entropies [5], 
depends on At and is consequently ill-defined (not fully defined by the stochastic 
process). To reach a uniquely defined measure of information transfer, Goychuk 
and Hanggi [5], introduced the relative entropy (or information gain) 1C, the de¬ 
viation of the process entropy in presence of the stimulus from the entropy value 
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in the absence of stimulus. This information gain is defined using the Kullback- 
Leibler divergence |16j of the probability density E„ for events occurring in the 
presence of stimulus from the probability density E„ for events occuring in the 
stationary condition without stimulus. This information measure is independent 
of the resolution Ar and is given by 


/C(t,to) = S(t,to)ln(||^ 


+ 


( 8 ) 


E 


dti 


dt2 


dt^i^n 




^=l "^*0 


1 ^o) 


En (t, 


, to) 


Our goal is to evaluate, for the signaling module introduced in Sec. 2, the infor¬ 
mation gained about the input stimulus V(t) from the knowledge of the output 
a{t). In the module of Fig 1, given an initial concentration a^, to each realisa- 



Figure 2: Examples of time courses for the dimensionless calcium concentration a{t) following 
from Eq. ([^ for a given sequence tn of channel state switches. Thick, dashed and dotted 
lines correspond to A = 10.0,1.0 and 0.1 respectively. 

tion, or trajectory, of S{t) corresponds univocally one trajectory of a{t) (see Fig. 
2). The trajectories of a{t) can be therefore grouped in four sets determined by 
the initial and final channel state. Let be the probability of having a 

given realisation of a(t) in correspondence of n opening and closing events of the 
channel occurring between 0 and t (indicated with tn for brevity), with i,j = ± 
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indicating the initial and final channel state respectively (+ meaning open and 
— closed). We introduce then the analogous probability for the unperturbed 
channel dynamics i.e. corresponding to have neither stimulus nor 

feedback applied and we use (<„,<) for the dynamics including feedback but 
not the stimulus. For the unperturbed process the waiting times distributions 
(WTDs) in each of the two states are Poissonian, i.e. iP±{t) = and 

the corresponding survival probabilities ip^{T)dT = . It follows 

that the probability t) of a time realisation of a[t) with a sequence of 

channel switches beginning in state i of the channel and ending in state j is (in 
absence of stimulus and feedback): 


= P,(cro)V’-i(Tl)^/’,°(r2) • • • 'l/'-j(r„)4'°(t - tn) 


where Tk = tk — tk-i and Pi{cro) is the probability that at time t = 0 the gate 
is in state i and the initial concentration is ctq. 

Eq. Q applied to our module of Fig. 1 with the notation introduced above, 
becomes 


IC[a\V] = Y. 


ij=± 


In = 




^u{t) 


(9) 


OQ pt nt nt / 

Y dti dt2--- dtn^ij {tn,t) In ( 

J t\ Jtn — l \ 


Ejj (tn, i) 


which, since there is a one-to-one relation between the output trajectories a{t) 
and the sequences of channel switches, expresses the difference in uncertainty 
about the calcium fluctuations in the absence and presence of the input. Note 
that Eq. does not include any averaging over inputs; rather, it is the infor¬ 
mation gain for a specific input realization V{t). 


4. Evaluation of the information gain 

In this section, we carry out a perturbative calculation of the signal-induced 
information gain in the presence of feedback. For a switching process without 
feedback, the information gain was derived previously in [9] . To evaluate Eq. 






in our case, the probabilities Tiij{tn,t) and must include the feedback 

contributions to the desired order in 

Perturbation due to either the stimulus or feedback leads to time-dependent 
rates and consequently modified survival probabilities (t, t^) = exp[— ^±dt'] 
in each of the two channel states. The ensuing processes are non-Poissonian, 
since the perturbed rates 7± depend on time, with WTDs V'±(i) ik) = tk)/dt 

which for small perturbation can be expanded as: 


tk) = i’+ij) 1^1 -b evV {t, tk) + ffyV' (T 4) • • ■ 

^-{T,tk) = 1 -b ea^'^{T,tk) + el'tp'^\T,tk) ■ ■ 


(10a) 

(10b) 


where t = t — tk- The first order corrections are: 

rtk+r 


tk) = v{tk + T)-j+ I 

Jtk 

-* rtk+T 

V'‘^(t, 4) = cr(tfc-b r|ffe) - 7 _ / ( 

Jtk 


dxV{x) 


dx(7{x\tk) 


(11a) 


(11b) 


and the corresponding expressions for higher order corrections can be analo¬ 


gously derived. The appearance of tk in (11 d) remarks the dependence of this 
correction on all the sequence of events up to time tk ■ Due to the form of Eqs. 


(11) and of the analogous higher order corrections, the WTDs in Eqs. (101 
remain normalized at each order (the perturbative corrections integrate to zero 
as can be checked by applying integration by parts on the first order corrections 
while using Eqs. As the integral of a{t) in Eq. can diverge with 

r, the validity of the small perturbation expansion for '0_ has to be examined. 
The terms of the expansion of the information gain ensuing from the adoption 
of Eqs. 0 can be proved to be well behaved when averaged over sequences 
(see Appendix, last paragraph). Carrying out the expansion to second order 
according to the Eqs. (10) and 0 leads to: 

Sy (t„, t) ~ -b Sv^Yj + {pYj^ + ^Yj ) + 


-b EaSy'^iY' + P 




( 12 ) 


where to lighten notation we have dropped the dependence on {tn,t) in the 


terms on the right-hand side. In Eq. (121 the first order contributions to the 
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expansion for small ey, Eo-( indicated by superscripts V and a) are obtained by 
adding to the corrections obtained drawing only one interval in the 

sequence with a WTD perturbed up to the first order correction in Eqs. (101 
while the remaining intervals are generated with unperturbed WTDs '0^(r). 
The second order corrections to are obtained either by drawing two 

intervals in the sequence with WTDs corrected to first order (superscripts 
VV, aV, a<j) or by drawing only one interval in but with WTDs corrected up 
to second order (superscripts with the remaining intervals drawn with 

unperturbed WTDs V'i ('’’)• 

Considering the probability = Qij{Scr, ey) as function of the small 

parameters eo-,ey, due to the structure of Eq. 0 the information gain is a sum 
of terms with the following functional form: 

Qij ) 


^ij (^CT; ) — Qij (^cr; ) la 


Qij (^(T; 0) 


(13) 


A Taylor expansion of Gij{ea, sy) to second order around = sy = 0 leads to: 


GijiCfj^Cy^ — 


dQij {.^(7 7 ) I 

dey 


=£^=0 + £a-£V 


d‘^Qij{£a,£v) 

de^rdsy 


(14) 


dQij{ea,sv) dQij(e„,ev) ' 

^2 

d'^Qij{ea,£y) 

( 9Qij(e^,£v) ^ ^ 

V dev ) 

d£a dsv 



+ 2 

S(^—ev—0 

d£y 



with all missing second-order terms having coefficient equal to zero when eval¬ 
uated at £cr = £y = 0 (for the full formal expansion see Appendix). Replacing 


the expression of Qij in terms of using Eq. (12), one obtains for the second 
order expansion of Gij the following terms: 


Gij{£a7 £y) — £yEj -(tn, t) -\- EaSy^ii {tm t) + 


+ £\. 


^Yi (^n,i) + E)^'^(f„,f) -I- 


^) 


(15) 


with the contribution of order e'^ being exactly zero. As already mentioned, 


Eqs. (10) imply that the corrections to the unperturbed WTDs integrate to 
exactly zero over time, so that the WTDs remain normalized. As a consequence 
Elf(t„,t), when averaged over all possible sequences tn and initial and final 
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channel state, adds up to one, while all the perturbative corrections of each 
order give a zero overall contribution. It follows therefore that integrating and 


summing Eq. (151 over all possible paths and initial and final state 
the linear term Ejij, and the second-order terms and EE^ give zero 


contribution. 

Let us then analyse the remaining 2"'“-order term: Al^' = ■ 

Considering for example the case of initial and final closed state i = j = —, 
we obtain 


AY'^_{t^\U:t) = A''^i{tAnr ■ -tk - ■ -tiAo) = 


,( 2 ) 


2E0_(r„,fc,t) 


= ^ 2'^°V +(n)'0-(T2) • • • 'ilY'{Tk+lAkf ■ ■ ■ ■!/'-('r„)«'+(t - tn), (16) 

where 'I'^ are unperturbed survival probabilities for the channel opening/closing 
events. Further subscript k in indicates the perturbed time interval within 


the set of n time intervals, with k and n in (16) being even integers for i = j = —. 

For the distribution of initial conditions F’±(cro), it is natural to assume a 
stationary solution for channel dynamics with feedback but no stimulus. In this 
case the initial probabilities are L±(cro) = 7±/(7+ -I- 7_) ± E^, where a linear 
correction Eg- oc £„ is added to the stationary solution for the unperturbed 
dynamics without feedback. It follows that the correction due to feedback in 
-P±(o’o) produces in Eq. (13) a contribution of order £y£a-j and can therefore 
be neglected to second order. Moreover, a direct calculation shows that this 
correction is oc (t) and therefore vanishes on the channel 

state switching time-scale. It can consequently be neglected also to third order 
when evaluating information gain over long time intervals. Averaging over all 
possible paths, the second order contribution Aij to the information gain is: 


= X! / dtn\kAf itn\kA) = 

ij,nk 


(17) 


= ey / dujduj'V{uj)V{uj') 


i7+7[l - 


2{u} + u}'){j_ -b7+) 

where the sum over n runs from 1 to -l-oo {k < n) and for convenience of 
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calculation we introduced the Fourier transform V(u) 


V(uj) = / dte-^‘^Wit) 


( 18 ) 


of the stimulus F(t), adopting the character i for the imaginary unit. Taking 
the time derivative and integrating over frequencies gives the rate of information 
gain: 

rir r?. ^ ^^ 

(19) 


dt 2 7 + + 7 _ 


which coincides with the result obtained in [5] for a similar signaling module 
without feedback. 

In order to see the contribution of the feedback one then has to expand Eq. 


(15) to third order. This leads to the additional terms shown in Eq. (A2). After 


summation, integration (for details see Appendix) we obtain 

= \^ J dtr,\kiA[j\*n\kht) = - 


te’^Sa- 


7+7- 


ij^nkl ‘ 

uj + uj' 7 _ + 7 + + A 


2 ( 7 ++ 7_)2 


( 20 ) 


We differentiate (20) with respect to time, integrate over frequencies and add 


up to (19) so as to obtain the information gain rate including the feedback 


contribution: 


dt 2 7 + + 7 _ _ 


1 + £tT" 


7+ 


7+ + A 


( 21 ) 


7+ + 7- 7+ + 7- + 

where terms vanishing on time scale t ^ max(A“^, 7 +^), which include those 
carrying the dependence on the initial concentration (Tq, have been neglected. 
Our calculation was carried out for the case of the input and the feedback acting 
on the opening and closing rate, respectively. Our approach can obviously be 
extended to the case of interchanged action of feedback and input on the rates. 


which would lead to the same result as in Eq. (21) with the simple interchange 
7 + 0 7 -. In the case of both feedback and input affecting the same rate, the 
leading feedback correction would again be of order SaSy, but the coefficient 
would be different. The terms of order e.g. e^ey in the derivation can in this 
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case emerge from perturbing to second order the same switching event, while 
in the case we analyzed they can only emerge from perturbing two switching 
events to first order. Derivation of the correction for this case, as well as of 
higher-order corrections, is beyond the scope of this paper. 


5. Discussion 


The information gain rate Eq. (21), when integrated over a time interval 
[0,T] with T ^max(A“^, 7 ^^), gives the total information obtained about the 
stimulus by observing the output. It is seen that (to first order in feedback 
strength and second order in stimulus strength) the information gain depends 
only on the total power jJ" dtV‘^(t) of the stimulus, rather than on the spectral 
distribution of this power. This implies that the information gain rate cannot 
be optimized by matching the temporal structure of the stimulus with the time 
scale of the feedback dynamics. 


The factor 


7+7- 

7+-1-7- 


in Eq. (21) expresses the rate of ’double flip events’ (i.e., 


openings and successive closings of the channel) in the absence of stimulus and 
feedback. In the case = 0, the information gain rate is therefore simply 
proportional to the unperturbed rate of double flip events. QTo examine if an 
analogous relation holds generally, we evaluate the mean rate of double flip 
events in absence of stimulus but in presence of feedback. The mean closing 
rate is given by 7 -(l + £ad+)^ where is the average concentration when the 
channel is in the open state. To obtain a result valid to first order in e^, it is 
sufficient to express <7+ to 0*^ order; this conditional average was computed in 
Ref. [H] and equals 


cr+ = 


7 - -I- A 
7- + 7-h + A ■ 


( 22 ) 


^The true double flip rate in the presence of stimulus differs from by a correction 

that is first order in sy. In Eq. such a correction would result in a higher-order term 

o{e^), which is beyond the order in which we carried out the expansion. 
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The mean rate of double flip events in the presence of feedback is then given by 


R = 7+7-(1 + e<Tcr+)/(7+ + 7-(l + 


(23) 


7- +7+ 



and Eq. (21) becomes 



(24) 


The information gained per double flip event is therefore given only by the power 
of the input and does not depend on the feedback strength or on the kinetic 
parameters 7 +, 7 _,A. 

Before relating this result to findings from the previous literature, we first 
point out that the definition of feedback in communication / information theory 
is more restrictive than the definition used in the literature on biochemical sig¬ 
naling. In the biological literature, feedback arises when a product of a signal 
transduction step influences the upstream components in the pathway. This 
fits with the general definition of feedback in the early cybernetics literature: 
’’When (this) circularity of action exists between the parts of a dynamic system, 
feedback may be said to be present” m- In communication theory, however, 
feedback is typically required to act in such a way that it effectively modihes 
the input of the system. The signaling module analyzed in this work contains 
in fact a feedback loop in the former sense; functionally, such type of feedback 
permits to e.g. achieve sensory adaptation to repeated stimuli m and can im¬ 
prove the temporal resolution of signaling jS]. In the latter sense (viewed as a 
communication channel), however, our module cannot be said to have feedback, 
as the input V{t) is not combined with the output. Rather, the back-coupling 
implements an autoregulatory loop with the communication channel. The ef¬ 
fect of the autoregulatory loop is to give memory to the channel state-switching 
dynamics: the closing rate depends (through the instantaneous calcium con¬ 
centration) on the full history of previous channel opening and closings. Our 
signaling module can therefore be viewed as a non-Markovian point process 
channel without feedback. 
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Following this clarification of terminology, to put the results of Eqs.(211 and 
(24) into perspective, we recall a known result from information theory It was 


proved in [BUS] (see also [ID]), that for any Markov point process the channel 
capacity per event cannot exceed the capacity of the Poisson process. I.e., the 
capacity per event is not improved by memory. While we have calculated the 
information gain rate for one realization of the stimulus (rather than the channel 
capacity), our finding may be viewed as somewhat analogous. In our case, the 
channel is non-Markovian, but as the memory decays exponentially in time (akin 
to a Hawkes process), the system is ’near-Markov’. It is possible, however, that 
a different result (i.e., information gain affected by memory) would be obtained 
if we carried out the perturbation expansion to higher orders in Sa- For discrete¬ 
time (rather than point-process) channels, the influence of memory on channel 
capacity was recently analyzed in |2T1 [22] . 

In [7], an analysis of several prototypical signaling pathways with feedback 
was carried out under the additive Gaussian noise approximation. Under this 
restriction (see also Sec. 1), the authors were able to compute the mutual in¬ 
formation rate for modules in which nonlinear feedback affected the activation 
of an upstream component. They concluded that when the feedback was me¬ 
diated by the final output of the pathway, no improvement of the information 
transmission was obtained. This is reminiscent of our main hnding. In [7], an 
enhancement of information transmission was obtained only when the feedback 
was mediated by an intermediate product in the pathway, and not the final 
output. The module we analyzed in this paper (Fig. 1) falls outside of this 
class. 

In conclusion, we presented a novel perturbative approach that permits to 
analytically evaluate information transfer through non-Markovian point process 
channels. We applied this approach to a prototypical signaling module with 
biochemical feedback and showed that to first order in feedback strength the 
information gain rate is increased by negative feedback (and decresead by posi¬ 
tive feedback). However, this change in information gain rate is fully accounted 
for by the feedback-induced change in the rate of signaling events (channel 
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opening/closings). To first order in feedback strength, the information gain per 
signaling event is not affected by feedback. 
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Appendix: Expansion of the Information gain 


The Taylor expansion of Eq. (13) to second order in ey gives 






d£a 


+ £y 


dQij (^cr ; ) I 


de 


V 


\e„,ev=0 ' 




(Al) 


d£l 


d£„ 


Qij (^CT ) ) 


+ 




Qf,(e<T,0) 


d£a 


^Qij ^Qij (^(T 5 0) 


d£(j 


d£a 


d Qij(^£a^^^ ^v') 

d£l Qy(e<T,0) 

d‘^Qij{£a,£y) 


Scr ,£^^=0 




( ^Qij {^^(T ■) 


delr 


^v') \ Ocy 


+ SaSy 


1 dQij {^^(T■) ^v') ^Qij {^^(T■) ^v') 


. S(j—sv—0 


d£ad£y Qij{Scr,£v) d£a d£y 

from which it is readily seen that the coefficient of the term oc £a and oc 
vanish when evaluated at £„ = £y = 0. 


Expanding Eq. (131 to third order, following the same procedure as in Eq. 


(All and converting back Qij to leads to three additional terms: 


£^—sv—0 


-2 _ 
£^£y 
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where we have used the next order expansion of (12) i.e. 

t) ~ + Sv'^Yj + + '^Yj ) + ^o-EyS: 

+ (e-/ + S-;) + 4 (e^/- + + E-;) + 


<tV 


(A3) 


^C7^V 


SrrS' 


o-cy 


+£3^(5 


‘ij 






The third term in Eq. (A2) depends only on the stimulus while the first, pro¬ 
portional to e^Eyi is exactly the same coefficient that would appear as the third 


order in the expansion in Eq. (12) and therefore gives zero contribution after 


integration over and summation, since perturbative corrections do not affect 
the normalization of the unperturbed part. Therefore the contribution with the 


feedback is given only by the term proportional to EyEa in Eq. (A2), whose 
first element can be written as: 


V 




U ‘^J _ I V' 

^^3 


(s 


^3 vO 


^ij 


^crV^ 


+ E 


(s 


V yO 


-E 




(A4) 


The term between brackets has been so rearranged in order to show that after 
summation and integration, it gives zero contribution (since it corresponds to 


the term of order EyEa- in the the expansion of Eq. (12), i.e. first term in last 


row in Eq. (A3)). The last term in (A4) gives a contribution that vanishes on 


the time scale of the channel opening/closing dynamics. The remaining term 


combines with the second element in the feedback contribution in (A2) taking 


an overall 1/2 coefficient. The expression for this term, evaluated between initial 
and final closed states, is: 

2 

(A5) 


AYUU,i,t) = El_ (" 1 ^ 


= P_(cro)'0+(Ti)-!/'_(T2) • • •'0 (Tfc+1,4) • • • V''^(rz+i|ti) ■ ■ ■ - tn) 

where further subscripts k and I in tn\k,i indicate that the closing and the opening 
events affected by the stimulus and the feedback are respectively the and 
the of the n event occurring between 0 and t. '0'^('n+i|ti) is the first order 


term given by Eq. (11) and carries the dependence on the history of the process 


17 

















prior to ti (i.e. the all sequence ti of events up to U), but, due to the exponential 


form of the WTDs, does not affect the convolution structure in (A5). 
Averaging over all possible paths gives: 


^ X! / dtnikiAf = - 


ISyEa 


ill- 


ij,nkl 


2 ( 7 ++ 7_)2 


(A 6 ) 




w + w' 7 _ + 7 + + A 
plus terms that either do not depend on t or vanish for time t <?;max(A“^, 7 +^) 
exceeding the channel state switching time scales. 

Finally a remark on the validity of the perturbative approach we introduced. 
This approach is based on a direct perturbation of the switching rates and 
therefore of the WTDs, due to both input and feedback. The only delicate 


point in following this procedure is the integral of a{x\i) in Eq. (11 d), which 


can diverge with t. It can be verified, however that this correction is well- 
behaved after summation over all stochastic paths and integration. In fact we 
can replace the contribution of this integral to the first order correction in Eq. 


(11 d) with the term — 7 _' 0 ° ('r)r, which is the upper limit to the correction due 


to the integral between 0 and r according to our perturbative prescription. The 
Laplace transform of this correction is 

2 




dt^_ te 


2 y.^-7-tg-st 


7- 


where 


V>^(s)=£[7-e-^-‘] = 


dt^-e 


7 - -I- s 






1 - 


7 - -b s 


(A 6 ) 


(A7) 


We can now replace Eq. (A 6 ) in the transition amplitude. Due to the con¬ 


volution structure of Eij(r, f) in terms of WTDs, this replacement adds just a 
multiplicative factor in Laplace space. The final result is (for i = j = —) 


E__(s) = S°_(s)(1 + £<,^°(s)), 


(AS) 


where we have included only the contribution of the integral and not the first 
term in Eq. & since the latter is trivially well-behaved. Due to Tauberian 
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theorem, one can deduce the time asymptotic limit by analyising the s —>■ 0 
behavior in Eq. (A8). Since tp-{s) —>■ 1 for s —>■ 0, such correction obtained 
after averaging over trajectories is always limited, non-divergent and therefore 
well-behaved for t oo. 
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